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ABSTRACT 


The purpose of this paper is to develop a 
definitional framework fOr the constrained 
Optimizaticn of an objective function with stochastic 
parameters. Included in this definitional framework 
are the construction of a deterministic reformulation 
for the stochastic problem, guidelines for selecting 
an algorithm or optimizing the deterministic 
reformulation and a criterion, called invariance, 
which is used for sclution sensitivity analysis in the 
context of stochastic parameter behavicr. 
Illustration of the application of the definitional 
framework and an analysis of the conditions imposed by 
the invariance criterion is provided for linear, 


piecewise linear, and guadratic functions. 
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I. INTRODUCTION 


The overhaul of a naval vessel is a three phase event; a 
planning phase of approximately one year, an industrial work 
phase, and a post-overhaul and inspection phase. The 
typical overhaul has a budget in the millions of dollars and 
involves several thousand individual jobs which are normally 
aggregated into a much smaller number of managerial groups. 
In this paper these managerial groups will be referred to as 


Stages. 


A major event in the overhaul planning phase is the job 
screening conference. The purpose of this conference is to 
identify the stages in which advance planning and 
procurement should commence. This is accomplished by 
individually reviewing the proposed jobs in each of the 
stages and selecting, within stage and overall budget 
limits, those jobs which will be accomplished during the 
overhaul. This screening process is, in effect, an implicit 
approach toward an optimal allocation of the available 
resources. As these resources are increasingly limited 
there is growing interest in formalizing the screening 
process intc an explicit optimization which uses the 
standard tools of mathematical programming. One formidable 
obstacle in the development of the explicit optimization 
model is the identification of a measure of effectiveness 
which is applicable to each of the stages. Even assuming 
the existence of some measure there remains a baSic problen 
Which arises from the method of determining return as a 
function of resource allocation for each stage. These stage 
return functions will rarely be explicitly known and 


therefore must be estimated from available data. Regardless 





of the quantity and quality of the data the estimation will 
result in stage return functions with parameters subject to 
random error. Thus, in addition to identification of a 
measure of effectiveness, a prerequisite of explicit 
optimization of overhaul planning allocations is an ability 
to conduct constrained optimization of an objective function 


whose parameters are subject to random error. 


The optimization of an objective function with 
parameters subject to random error falls into the general 
realm of stochastic programming. As noted by Nemhauser [8], 
the concept of optimization in the presence of stochastic 
behavior 1S not well defined, and is the subject of 
continuing discussion. From this discussion two definitional 
frameworks have arisen. One is highly theoretical and is 
exemplified by statistical decision and game theory. The 
other framework is more computationally oriented and is 
exemplified by the method which addresses the creation of a 
deterministic reformulation of the stochastic program to 
which the optimization can be applied. There are several 
variants but the central idea of a deterministic 
reformulation is to select a particular value from the range 
of each of the stochastic parameters, a common choice is the 
expectation, and to treat these values as deterministic 
parameters for the purpose of optimization. The approach is 
open to considerable criticism, the most common being the 
failure to account for possible effects on the solution 
caused by differences between the realizations of the randon 


variables and the values used in the optimization. 


The goal of this research is to develop, for an 
arbitrary measure of effectiveness, a definitional framework 
for the optimization of the general class of stochastic 
programs posed by the overhaul planning problen. The 
framework is to be computationally oriented and based on a 


deterministic reformulation. The method defines a concept 





called "invariance" which is used to assess the effect of 
stochastic parameter behavior on the set of stages in which 
no advance planning and procurement actions are indicated. 
The criterion is directed toward this set rather than the 
set of stages in which advance planning and procurement 
should commence since the costs associated with the 
erroneous inclusion of a stage in the 
no~planning-and-procurement set are much larger than the 
costs associated with the erroneous inclusion of a stage in 


the advance~rlanning-and-procurement set. 


Chapter two will develop a mathematical model of the 
overhaul planning problem, define the invariance criterion 
and develcp the conditions imposed by this criterion on the 
deterministic reformulation and its optimization. Based on 
these conditions a solution approach for the optimization of 
the overhaul planning problem is proposed and its 
application illustrated in chapters three, four, and five 
for linear, piecewise linear, and guadratic stage return 


functions. * 





A. MATHEMATICAL FORMULATION 


Assuming that there are n stages to be considered by the 
Screening conference a mathematical formulation cf the 
overhaul planning problem is dependent on the identification 
of a composition operator used to form the overall objective 
function from the individual stage return functions. As the 
overhaul planning problem is of an economic nature, that is: 
ale addresses the allocation of Scarce resources, any 
arbitrary measure of effectiveness is, in effect, a form of 
utility measure. A reasonable choice for the composition of 
the stage returns into an aggregate measure of the utility 
of the total overhaul package is summation. That is, stage 
returns are assumed additive. Based on these assumptions 
one mathematical formulation of the overhaul planning 


problem is: 
n 
4 
MAX De reeds) 
Jeti 3 


nN 
s/t oa Guus 5D 
j=1 Jj 


OS£da Ss ub j=1,2,---,n 
J J 
where 


* th 
r (dad) is the j stage stochastic return function. 
J 





th 
Geel outne 19 stage decision variable. 
BD is the total budget constraint. 


ae is the ; stage budget constraint. 
Based on the economic context of the problem, it is assumed 
that stage allocations are subject to diminishing returns, 
thus the stage return functions are concave. In the same 
context it is also reasonable to assert that the sum of the 
individual stage budget constraints exceeds the total budget 
Genscraint, thus at optimality the total budget constraint 


will be binding. 


Be. DEFINITIONAL FRAMEWORK 


1. Deterministic Stage Returns 


As previously noted the concept of optimization in 
the presence of stochastic behavior is not well defined. The 


stochastic optimization problem formulated above is to be 


defined in terms of a deterministic reformulation, each 


= 
me (a ) being converted to. a deterministic fr (d) by’ 
J J J 


selecting from the respective ranges a specific value for 


each of the Stochastic parameters. The optimization of the 
deterministic reformulation is to be achieved by application 
of one Gr the existing algorithms of mathematical 
programming. The specific algorithm will depend on the form 
of the stage return functions used in the deterministic 


reformulation. 


10 





Sitivity Analysis 





The effect of stochastic parameter behavior on the 
optimal sclution of the deterministic reformulation can be 
observed from three viewpoints, in terms of the values of 
the decision variables and the value of the objective 
function, in terms of the solution set or in terms of the 


complement of the solution set. 


+ 
The solution set S for an n-variable 


m-constraint problem is defined as the 


set of variables different from zero. 
The complement of the solution set, 
0 


denoted S$ , is the set of variables 


which are zero. 


As this problem is in a planning context the solution 


+ 
set S , which identifies the stages in which advance 


planning and procurement should commence, and its complement 


fe) 
S , which identifies the stages in which there should be no 


advance planning and procurement, are more important than 
the values of the decision variabies or the value ctf the 
objective function. Since the costs associated with a stage 


0 
being incorrectly included in S are much larger than the 


11 





cost of a stage being incorrectly included in s, the 
sensitivity analysis of the solution to the deterministic 
reformulation should be directed toward the complement of 
the solution set. Invariance, defined below, is the 
criteria which will be used to assess the sensitivity of the 
complement of the solution set to the stochastic parameter 


behavior. 


The optimal solution of the 
deterministic reformulation is invariant 
with respect to the specified ranges of 
the stochastic parameters, if within 
those specified ranges no zero valued 
varlable is required to depart the 
ccmplement of the solution set, that is 


become positive, to maintain optimality. 


Basically fcr a solution set to be invariant the variables 
of the deterministic reformulation which have an optimal 
value of zero must remain at zero for parametric 


perturbations throughout the specified ranges of the 


stochastic parameters. There are two concepts in the 
definition of invariance which require additional 
development. 


a. Specified Parameter Range 


Invariance is defined in terms of specified 
ranges for each of the stochastic parameters. Some of these 
parameters may be the result of a statistical regression and 
as such they are assumed to be normally distributed random 
variables with a nominal range of (-W~,@). Ranges of this 


Magnitude would always violate the invariance criterion, 


12 





thus one requirement for meaningful analysis of solution 
sensitivity 1s range restriction for each of the stochastic 
parameters. The restriction must be accomplished about the 
value of the parameter used in the deterministic ° 
reformulaticn and must provide a reasonable chance for any 
realization cf the random variable to be in the restricted 
range. Additional assumptions for this paper are that the 
restricted ranges are symmetric about the parameter value 
used in the deterministic reformulation and that 
perturbations in any given restricted range have no effect 


On perturbations in any other restricted range. 


The individual restricted ranges nay be 
developed with statistical confidence intervals, [4] and 
[9], from previous experience, from known physical 
limitations or any other approach which yields a restricted 
range meeting the guidelines established above. The 
specific method used to establish restricted ranges for an 


invariance analysis is not dealt with in this paper. 


The restricted range for a stochastic parameter 


ae 
Cc will re denoted as; 


~e 
IA 
-~o- 
lA 
von 


where 


c is used in the deterministic reformulation. 
J 


@ is a random variable. 


* 
6 is the limit for perturbations toc. 
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b. Changes to the Solution Set 


A requirement of the invariance criterion is an 
ability to identify when a variable must depart the 
complement of the solution set to maintain optimality. FOL 
an algorithm to be useful for the optimization of the 
deterministic reformulation in the context of the invariance 
criterion it must be possible to perturb a problem parameter 
Without necessitating a complete reapplication of the 
algorithn. 


Ge SOLUTICN APPROACH 


For arbitrary return functions the stochastic program 
posed by the overhaul planning problem can be optimized 


within the definitional framework of invariance by: 
1. selecting the parameter values to be used in the 
deterministic reformulation, 


2. restricting the range of each stochastic parameter 


about the value selected in step one, 


3. selecting an appropriate algorithm, depending on the 


form of the deterministic reformulation return 
functions, and optimizing the deterministic 
reformulation, 


4. introducing perturbations within the established 
ranges to the stochastic parameters and checking the 


invariance condition. 


14 





This approach will be illustrated for common classes of 
stage return functions and for each class tests of 
invariance will be identified. The classes of return 


function to be examined are linear, piecewise linear, and 


quadratic. 


15 





III. LINEAR STAGE RETURN FUNCTIONS 





The simplest function in the general class of concave 
functions is the linear function and while the assumption of 
linear stage returns may not be very realistic in the 
economic context it does provide a useful starting point for 
illustrating the application of the definitional framework 


developed to optimize overhaul planning allocations. 


Assume that each of the n stage return functions isa 


linear function of the forn 


The initial steps in the proposed solution approach are to 


* 
select the values of a. and zr penespectiaveily da) -and ¢., 
B 3 J 


for use in the deterministic reformulation and to establish 


restricted ranges about a andc.. Given the estimates of 
J J 


a andc with appropriate restricted ranges about them and 
J 3 


the general mathematical formulation of the overhaul 


planning problem the linear deterministic reformulation is 


16 





n 


MAX = (a>. Sb eed) 2) 
a3 I 3 


n 


S7ie Sr das 2D 
i 


GO 295 Ss) ape j=), 2,---0- 
3 3 


* 
AS a affects only the value of the objective function it 


can be dropped from the formulation with no loss of 


generality. The resultant simplified formulation is 


em) 


OFS 0p seul Sg =4, 27. 0 


and the invariance condition need only be checked fer the 


e 
restricted ranges of c. 
J 


{ 
o- 
lA 
<3 
lA 
-~o- 
6 


ane deterministic reformulation above is a linear 


program and the most common algorithm EO such an 
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optimization is simplex. The simplex algorithm can accept 
parameter perturbations via the parametric sensitivity 
analysis techniques outlined in Gass [5] and is therefore 
useful for the optimization of the linear deterministic 


reformulaticn in the context of an invariance analysis. 
AS a reference for the investigation of the conditions 
imposed by the invariance criterion, consider the following 


four stage (n=4) example problen. 


MAX 41.4d + 1.6d + 1.3d + 1.7d 
1 2 3 4 


lA 


s/t d + d + qd + d 10 


1 2 33 u 


d 
1 


lA 
U1 


Au 
lA 
lJ 


d <4 


doe 0 = 1 one 


For this problem the optimal simplex tableau is 





where columns five through nine are Slack variables. 
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For notational Simplicity and without loss of 


generality the following assumptions are made; 
1. The standard simplex tableaus are used and are 
arranged so that the first n columns are the 


St 
decision variables (d). Pie r+ column is the 
J 


Slack variable for the total budget constraint, 


which is binding at optimality, and columns n+t2 
through 2n+1 are the slack variables for each of the 


decision variables. 
2. At oftimality there is no degeneracy and no 
alternate optimal solution. 
Notationally let 


B be the optimal solution set or basis. 


C be the vector of the c_ for j eB. 


th 
P be the j column of the optimal tableau. 


a be the vector of the » for j €B. 
J 


es be the vector sum of a and sa 


It iS important to note that for the slack variables both c_ 


and $6 are zero. 
3 - 


Linear optimizations have a property that for any 
variable to depart the complement of the solution set a 
Variable must depart the solution set. Given this 
One~to-cne correspondence between changes in the solution 


set and its complement the requirements of the invariance 


ig 





GEIcerlon can be Satisfied if within the specified 
restricted ranges for the stochastic parameters there are no 
changes to the solution set. In the simplex algorithn 
Changes tc the solution set can occur only if the algorithn 
optimality criteria are violated. Therefore, the key to an 
invariance analysis in the linear case is the optimality 
criterion of the Simplex algorithn. The optimality 
criterion of the simplex algorithm is that 
(2 em semeer ac 20 V4- 
a oe) B-J) 3 
Introducing the perturbations allowed by the restricted 
parameter ranges has the following effect; 
* ¥ * 
(Z-c) = ¢ Pc. 
Es, B J 3 
(Clee ea C tao.) 
BB 5 J 


(C P -c 
B 


) + (IP -9 ) 
j 3 Bg) 


or 


& 
(Z =-c ) = {2 - cy * (2 P~ @,) 
ae, J a) BJ J 


and as the perturbations were introduced at optimality the 
necessary condition to maintain optimality is that 
-(IP-o>) < (z-c) ¥. 
BJ J a a 
For the soluticn to be invariant the optimality maintenance 


condition must be satisfied throughout the restricted ranges 


of the stochastic parameters, that is for 


L L 


The presence of the E term in the optimality maintenance 


condition means that for any column j the maintenance of 


20 





Optimality is dependent on perturbations to parameter c_ and 


On perturkations to the parameters of the variables in the 
optimal basis. Thus in the optimality maintenance condition 
for any cclumn j there are mutual dependence effects fron 


the stochastic parameter perturbations. 


The constraint matrix of the problem has a structure 
which prcduceées an optimal tableau whose elements are either 
Minus one, plus one, or zero. Further the assumption that 
the total budget constraint is binding at optimality 
produces an optimal tableau with only four types of columns. 


These column types are identified as follows; 


Type O = columns of baSic variables. 

Type A = columns of non-basic decision variables. 

Type B = columns of non-basic slack variable. 

Type C = the column of the non-basic slack variable of 


the total budget constraint. 


These special features reduce the mutual dependence effects 
of parameter perturbations in the optimality maintenance 
condition and allow the development of tests of invariance 


for each of the column types identified. 


A. TESTS OF INVARIANCE 


Due to the special structure of the problem the simplex 
algorithm will bring the decision variables into the basis 


at their upper bounds ub sequentially in decreasing order 
of the rates of return. Under these circumstances 


optimality will occur when the entering decision variable 


21 





causes the tctal budget constraint to become binding. The 
decision variable which causes the total budget constraint 
to become binding will be the final variable to enter the 
basis and will be denoted oe For the example problem ve is 


d . 
1 


it. Colunnakype wet 


mae a ap aa 


As shown in Gass [5] parametric perturbations 
produce no change in the optimality conditions for type 0 


columns, that is 


x 
(ZAC) ae= OZ = Ce) = 10. 
eS ae) J 


Thus there is no requirement to examine the columns cf the 
optimal FEasis under the invariance criterion. In the 
example problem columns one, two, four, six, and eight are 


type 0 columns. 


2. Cclumn Type A 


Cclumn three of the example problem is a type A 
column. In general any column j of type A has three 
non-zero elements. These elements are located as follows: 

A plus one in the row of a In the example problen 
this is row one. 


A plus one in the row of the slack variabte 


£n 
associated with this, the j, variable. 


22 








A minus one in the row of tne slack variable 


associated with ae From the tableau assumptions 
the slack variable associated with oe 1s variable 
n¢f+1. In the example problem this 1s variable six 


which is associated with tableau row two. 


As the 9 of the slack variables are zero the scalar product 
J 


I P for a type A column must always be 
J 


and the optimality condition is 
= (EOS (28 aC) ir 
f£ 3 i) ee) 


aeeeze Cc) 61S 9a pOSttlive quantity the worst condition for 
J 


invariance is at 


and the test for invariance in a type A column is 


L i 
> tO eS Mice Coe). 
fc J hs and 


Je cCOLimn Lype os 


= ee csgp oe ae te 


Examples of typ2 B columns can be found in columns 
seven and nine of the example problen. In general any 
column j of type B has three non-zero eiements. These 


elements are Located as follows: 
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Eo 


and 


The 


and 


A minus one in the row of the a In the example 


problem this is row one. 


A one in the row of the slack variable of i Frcm 
the eee assumptions the slack variable 
associated with oF is variable n+tf+1. In the 
example problem this 1S variable six which is 
associated with tableau row two. 

A one in the row of the decision variable associated 


with this slack variable, by the tableau assumptions 


this is variable j~{n+1). 


this type of column the scalar product ae 1s 
) 


p 
Bo fe a> (n+ 1) 
the optimality condition is 


oer ) < (Z-c_). 
P4- (+1) a 3) 


worst condition for invariance occurs when 


%6 ” Pe 


ile 
vee (n+ 1) : j~ (n+1) 


the test of invariance for a type B column is 


err ee 
Zz = s 
f J- (net) ane 3) 
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4. Column Type € 


An example of a type C column is column five of the 
example preblem. In general for column (n+1), which is the 
only type C column, there are two non-zero elements. These 
non-zero elements are located as follows: 

A one in the row of ae in the example problem this 
1s row cone. 

A minus one in tke row of the slack variable 
associated with a From the tableau assumptions 
the slack variable associated with or 1s variable 


n¢f£+1. In the example problem this 1S variable six 


which is associated with tableau row two. 
The scalar product es for the type C column is 
ne 


1 P = 
B nt+1 . 


and the optimality condition is 


/ = > < (Z aC.) ae 
zs 3 Jj 


The worst condition for invariance occurs when 


and the test for invariance in the type C column is 


> a. ( ) 
ZC) 
£ Nia! 


2> 





The solution set is said to be invariant with respect 
to the specified parameter ranges if the tests of invariance 
are not violated for any of the columns of the optinal 


tableau. 


The tests developed above are sufficient but not 
hecessary conditions for invariance. Under certain 
conditions violation of the sufficiency test for a type B 


column may not result ina violation of invariance. This 


+ 
will occur when a variable in S can become zero without 


0 
requiring a variable in S§ to become poSitive. The condition 


for this cccurence is that it must be possible to allocate 
all of the units of resource from the variable which is 
dropping tc zero to the variable which is in the solution 
set but not at its upper bound (oe If the violation of the 


sufficiency test for a type B column occurs in column ia 
new condition for invariance should be checked. This 


condition is 


bb. > ub 
L~ (nt 1) f 1 


mroesSOLUtiOn will not be invariant if this condition is 
Satisfied since the resource not allocated to - must be 


0 
allocated to some variable in S$ to maintain optimality. If 


the conditicn is not satisfied the solution may be invariant 
but to determine whether or not the solution is invariant 


requires additional tableau pivots. 


Recognizing that the simplex algorithm brings the 
decision variables into the solution set at their upper 
bounds sequentially in decreasing order of their rates of 


return and that optimality occurs when a decision variable 
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can enter only at some value less than its upper bound a- 


logical statement of a test of invariance is 


- 


* * 
Mauer ctr" “Micmecc mares 
Seo 9 jeS* J 


This condition is equivalent to the tests of invariance 


developed above. 


Za 





IV. PIECEWISE LINEAR RETURN FUNCTIONS 


= SS = SS EE SS 


Since piecewise linear functions can exhibit diminishing 
marginal returns they are economically more realistic than 
the’ simple linear function. This increase in eccnomic 
realism is gained at the loss of some of the nathematical 
Simplicity of the simple linear return model. However, the 
highly desirable property of linearity is retained. 
Piecewise linear functions generally arise from two sources, 
one 1s segmented linear regression. The second and nore 


common source is the approximation of nonlinear functions. 


Assume that the individual stage return functions are 


piecewise linear functions of the form 


eee i = det Coe tC wert feiss tue e G./ 
J 


where 


and to ensure the desired concavity 


m n+ 1 
be Seale n= 142% suk}. 
a J 
Given the economic context of the problem it is reascnable 
to assert that marginal returns are strictly positive. fThis 
requires the piecewise linear function to be monotone and is 


ensured if 





7 


Graphically a typical three segment piecewise linear stage 


return function will have the forn 


ee, ie ee Se 


O UD, 
0 UD; 
0 ubs 
0 ub; 


A further requirement which ensures that the algorithm used 
for the optimization of the deterministic reformulation 


m+ 
correctly models the piecewise linear function is that d. 
J 


m m 
remain at zero until de. 1Stdtylbee es, ~Lteshould aise, de 
J 


noted that 


Dae 





tN 
= ub = ub Yj, 
j 


thus the original stage constraints remain in force. The 
assumption of k segments for each of the piecewise linear 
functions is for notational Simplicity and is made without 


loss of generality. 


n* 
The farameters c. can be regarded as approximations 
J 


th 
to the slope of the jj Stage return function over the 


o-1 m 
interval [ub. , ub j and as such they are subject to 
J 3) 


random e¢Irror. It must be noted that in addition to the 


guidelines for restricted ranges established in chapter two 
the restricted ranges in the piecewise linear case must 
ensure that the function remains concave and monotone 


aL 
increasing. If the limits for a restricted range are -9. 


mL 
and $. the maintenance of concavity requires that 


mM aL m+ 1 (m+1)L 
de PACE + o- MWg gale, K=O 
J J 3 J 


n 
Given the estimates of the c's with appropriate 
J 
restricted ranges about them and the general mathematical 


formulaticn cf the overhaul planning problem the piecewise 
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linear deterministic reformulation is 


n k 
m 
s/t Se dia Se BD 
j=1 m=1 3 
m m 
OF Sed Sub 1, 2, oe 2 
J 1 


N= Wisc oe cane ts 


x 
As a affects only the value of the objective functicn it 


can be dropped from the formulation with no loss of 


generality. The simplified formulation which results is 


n k 
m 
Fe > 4 < BD 
=t m=1 j 
m m 
0 <$ qd. < ub. = le eeagre oes El 
4 J 


ed ees 


and the invariance criterion need only be checked for the 
m* 

restricted ranges of c. 
3 
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The deterministic reformulation above is a linear 


n+ 1 
program except for the requirement that d-. remain at zero 


n m 
until d is at ub. Fortunately this requirement does not 
J 


prevent the use of the simplex algorithm since, as shown by 


Dantzig [1] and {2], the concavity of the objective function 
ensures that the requirement will pe satisfied at 
optimality. Thus the simplex algorithm is applicable for 
the optimization of the piecewise linear deterministic 


reformulaticn. 


For notational simplicity and without loss of 


generality the following assumptions are made; 


1. The standard simplex tableaus are used and are 
arranged so that the first nk columns are the 


n St 
decision variables qd ). The nk+1 column is the 
J 


Slack variable for the total budget constraint, 


which is binding at optimality, and columns nk#2 
through 2nk+t1l are the slack variables for each cf 


the decision variables. 


2. The column arrangement is by block according to the 
variakle index j and within each block the k 
segments are in order from one to k. Thus the column 


arrangement is of the forn 


le 2 kK. fa k 1 k 
ad *d d maa aay & | 
1 #1 1 2 n nt nt+2 2n+ 1 
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3. There is atableau row for each variable to enforce 
1ts respective bound. Thus the tableau will have 


nk+1 rows and 2nk+1 columns. 


4G. At optimality there is no degeneracy and no 


alternate optimal solution. 


Notationally let 
B be the optimal solution set or basis. 


D m 
Se be the vector of the b ford_ eB. 
J 9 


P be a column of the optimal tableau. 


m m 
ae be the vector of © ford  e€ 8B. 
y 2 


C be the vector sun of es and a 


The optimization of piecewise linear functions is a 
linear optimization and as such there is a one-to-one 
correspondence between changes to the basic and non-basic 
variables. However in the piecewise linear case this is not 
equivalent to a one-to-one correspondence between changes to 
the solution set and its complement. This is due to the fact 
that in the piecewise linear case invariance is directed at 
the original variables ad not at the piecewise segment 

J 
variables a The invariance condition can be stated as; 


if within the specified restricted ranges for the stochastic 


1 ) 
parameters the d which are in §& remain at zero the 
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solution is invariant. This condition can be checked through 


the Simplex algorithm optimality criteria. In the notation 
of the piecewise linear case the optimality criterion of the 
Simplex algorithm is ~ 

D m m m 


(Zac =tGere oc) =) 00Vj 7 a1, 2-00 he 
ae 2) al), 


Introducing the perturbations allowed by the restricted 


parameter ranges has the following effect; 


m nm * * fn mn * 
(2. =e) = Hew Se. 3. ee 
s J Diane 
m m 
=(C +I1I)P  - (ce a 
Bye od J 
m m 
=e EC re) wie eP ti ees 47) 
B 3 J J J 
or 
m nh * m m 
(Ze, = iC meee 5 cee ee Coe): Ste we. Pearsons) 
J J J a] B 3 
and to maintain optimality 
m m m m 
En Oa EG: (Zee ue alc 
eg J J J 


The invariance criterion requires that the optimality 
maintenance condition be satisfied throughout the specified 


restricted ranges of the parameters, that is for 


~~ 


“>. So, £9, . 


The piecewise linear optimality maintenance condition 
is, with notational differences, the same as the simple 
linear case. The only real differences are that there ate 
how nk total decision variables instead of the n for tne 
Simple linear case and that the optimality maintenance 


condition need not be checked for all o£ the columns cf£ the 
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optimal tableau for the solution to be invariant. The 
columns for which the optimality maintenance condition need 
not be checked are those of the non-basic structural 


variables which do not affect invariance, that 1S the 


m 

columns of d. where m1. These variables do not affect 
5 

invariance since the invariance condition for the piecewise 


1 
linear problem is stated in terms of the d. which are in 
J 


o 
Ss The special features of the problem, namely the 


constraint matrix structure and the assumption of a binding 
total budget constraint, are intact and the optimal tableau 
has the same four column types and element arrangements as 
the simple linear tableau. Thus the invariance analysis for 
piecewise linear functions is virturally identical to that 
of the simple linear case. The difference is that the only 


type A columns which must be checked for invariance in the 


1 
piecewise linear case are those associated with d's which 
J 


0 

are in S . Since the analysis for the columns which must be 
checked is the same in the piecewise linear problem as in 
the simple linear problem the tests of the simple linear 
case will simply be restated in the current notaticn for 
those columns of the piecewise linear case which are 


relevant under the invariance criterion. 
As TESTS OF INVARIANCE 


As in the simple linear case the subscript f denotes the 
decision variable which upon entry into the basis causes the 


total budget constraint to become binding. 


5) 





ioe COMMMnE hy De Cu( basic variables) 





No examination of the columns of the optimal 


is required under the invariance criterion. 





Structural variables) 


basis 


As pointed out above the only columns of type A 


which are relevant under the invariance criterion are 


those 


, 
associated with d ‘'s. The test of invariance for a relevant 


J 
type A column is 


3. Column Type B (nen-basic slack variables) 


The test for invariance for any column of type B is 


b i P Nig < m _ 
Z =e B 
f jeus 1) J J 


4. Column Type C (budget constraint slack variable) 


The test for invariance for the type C column is 


L 
p ee 4 = 1C ie 


f nk+1 nk+1 
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The solution set is said tO be invariant with 
respect to the specified parameter ranges if the tests of 
invariance are satisfied for all relevant columns of the 


optimal tableau. 


As in the simple linear case the tests above are 
sufficient but not necessary conditions for invariance. 
Under certain conditions a violation of the type B column 
sufficiency test may not be a violation of invariance. This 


+ 
occurs when a variable in § Can become zero without 


0 
requiring a variable in S$ to become positive. The condition 


for this occurence is that it must be possible to allocate 
all of the units of resource from the variable which is 
dropping to zero to the variable which is in the solution 


set but net at its upper bound Pe However in the 
plecewise linear case it is not possible to state a 


condition which checks for this behavior. This is due to the 
fact that violation of the allocation condition stated above 
may not resuit in a violation of invariance since the units 


of resource not allocated to oe may be allocated either toa 


m 
d where m>1, which would not violate invariance, or to a 


- 


1 ; 
d which would violate. invariance. 


— 


As in the simple linear case the simplex algorithm 
Will bring the decision variables of the piecewise linear 
case into the solution set at their upper bounds 
seguentially in decreasing order of their rates of return. 
Optimality will still be achieved when an entering decision 
variable encounters the total budget constraint and the 


logical statement of the tests of invariance remains 


a7, 





1x m * 
maxX C | < min c | [See pe tare Ke 
jeS J res 
mie SOLULLOD 91S “sata to be lpVariant Lf this condition is 


satisfied throughout the specified restricted ranges. 
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Quadratic functions are another move toward economic 
realism for the overhaul planning problem stage return 
functions. The advantage of a quadratic function is that 
Marginal returns can be made to be continuously decreasing 
whereas the piecewise linear fuse cron could only 
incrementally decrease marginal return. The gain in realism 
With the quadratic function has a large price, the loss of 
linearity. However this loss is partially offset since the 
quadratic function is one of the simplest of the non-linear 
functions and there is some advantage over piecewise linear 
functions because .of the reduced number of parameters and 


variables. 


Assume that each of the n stage return functions is a 


quadratic function of the form 


The conditions for the desired properties of decreasing but 
always positive marginial returns, or monotonic concavity, 
are that the first derivative be non-negative and the second 
derivative be strictly negative. This means that 
gee eg. 10) GIS) 7 
J | God! 
be 0. 


It should be noted that the restricted ranges in the 


quadratic case must, in addition to satisfying the 


guidelines of chapter two, maintain the monotonic concavity 
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of the individual stage return functions. If the limits of 


: * x 
the restricted ranges of a and b are respectively +9. 
J J 


and +0. the maintenance of monotonic concavity requires 
A 


that 


and 


Given the estimates of a and b with appropriate 

J J 
restricted ranges about them and the general mathematical 
formulaticn cf the overhaul planning problem the quadratic 


deterministic reformulation is 


1 2 
MAX « ad -—~bd- 
Se UI 3) eee) 


n 
S7s = ad < BD 
j=t ij 
0<d S$ ub j=1,2,...-n. 
j 


J 


Mae AnVariance condition must be checked £Eor the restricted 


X 
ranges of b- 
J 
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It will be notationally convenient to shift to matrix 


notation where 


Dis an ({nx1) vector of decision variables d. 
J 


Bo1S an (nxX1) vector Of parameters b. 
J 


Ais an (nxn) positive definite diagonal matrix of 


parameters a. 
J 


Iis an (nxn) identity matrix. 


1 is an (nx1) vector of 1's. 


UB 1s an ({nx1) vector of the stage constraints ub. 
J 


The deterministic reformulation can be written in matrix 


notation as 


= it 
MAX R(D) = AD- -> 5 DB 


This is a convex non-linear program and the Kuhn-Tucker 


conditions are necessary and sufficient for optimality. 
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The initial attempt to optimize the deterministic 
reformulation and apply the invariance criterion involved 
the use of quadratic programming, specifically the algorithm 
of Dantzig as described by Boot [3]. While this algorithm is 
Simplex based and technically satisfies the requirements for 
the application of the invariance criterion it involves a 
reformulation via the Kuhn-Tucker conditions and the 
resultant problen proved to be conceptually and 


computationally difficult. The specific difficulties were; 


1. The reformulated problen is conceptually an 
existence problem rather than an optimization 
problem. Thus there is no objective function in the 
usual sense and this prevents the determination cf 


Optimality maintenance conditions. 


2. The parameters to which perturbations are applied 
are in the constraint matrix and on the right hand 
Side of the reformulated problem. This situation is 
almost impossible to handle when perturbations are 


applied to more than one parameter. 


The second algorithm selected for the optimizaticn was 
the reduced gradient algorithm, [6], [7], and [10]. This 
algorithm is very Similiar to the simplex procedure, 
identifing variables as either basic or non-basic. One of 
the important differences between this algorithm and simplex 
is that here the basic variables nust be positive and the 
non-basic variables may be different from zero. The reduced 
gradient algorithn can also handle parameter perturbations 
Without having to reapply the entire algorithm, thus the 
algorithm is applicable under the requirements of the 
invariance criterion. To put the deterministic equivalent 
into the standard format of the reduced gradient algcrithn 


add slack variables to the constraint matrix and denote the 
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result as 


tix! 
D tat 10! BD 
{ 
aie | 
{ 
eal 
100) a Ol UB 


where 


Of is an (1xn) vector of zeros. 


O 1s an (nx1) vector of zeros. 


additionally at optimality let 


Z be the set of the nt1 basic variables. 
N be the set Of n non-baSic variables. 


P be the matrix of the columns of W associated 


the basic variables. 


C be the matrix of the columns of W associated 
the non-basic variables. 


th ete 
q, : be the 1] element in the k row of Q = P C. 
g 


It should be noted that 


+ : 
The solution set S has elements from both Zand N. 


0 
The complement of the solution set S has elements 


Oty eeecnm Ne 


The column arrangement of W is the same as the 
column arrangement of the constraint matrix in the 


linear case. 


For the slack variables 9, 8 , and d_ areall zero. 
J J i) 
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In the quadratic case there 1S no one-to-one 
correspondence between changes in the solution set and its 
complement. Thus the use of the invariance criterion in the 
quadratic case requires a direct application ee the 
definition cf invariance, that is the invariance analysis 
must be focused on the complement of the solution set, Ss 
The maintenance of optimality in the guadratic case 1s not 
necessary for invariance, in fact optimality will probably 
never be maintained. However, the optimality condition of 
the reduced gradient algorithm does provide a method for 


checking the invariance criterion. The optimality condition 


of the reduced gradient algorithm is that ail elements u of 
J 


the movement vector JU, defined below, be equal to zero. The 


elements cf the movement vector are defined as 


0 1—£ RG < 0 andd = 9 
i J 
HO V jey 
J 
RG otherwise 
i) 
é th | 
where RG is the j° component of the reduced gradient RG 
J / 
and 
-1 
RG = -¥ R(D) P C+ V R(D) 
2 N 
Or 
dee (Orr ediideenee + (45 «= bdo. 
j ZEZ Z Zl 02, 4 3 A 
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The key for the invariance criterion is that the 


0 
variables in the comvlement of the solution set (S ) are 


specifically required to have a reduced gradient component 


0 
which is non-positive. Departures from S can only occur if 


the perturbations within the specified restricted ranges 


cause the reduced gradient component of one of the variables 


0 
in S$ to become positive, thus invariance is dependent on 


the changes to the reduced gradient components cf the 


0 
variables in S produced by the parametric perturbations. 


Introducing the parameter perturbations allowed by the 
restriced ranges has the following effect on the ‘reduced 


gradient. 


ae ae me x % 
arial? es EU D POc gadis. on iby Genepe. (Died: 
5 ZEZ Z 1 NE A, a ajiu a3) 


eS a ee Ss Olen 
ZELsoaZ Z z ee 


a Sa 20 a © 2 
j j j 3 


SPN (a Sbdajici = teal oeorae 
ZeL eZ AA rae 5 3 ks 


OS 2 Oa iq > 8d 
zeEZz Z ZiCEPZ 9 3 5 seg 


-RG.-2 (6 -8a)q .+ 4,-0.4. 
ze Z Rh LGae 5 ea 


x 0 
For invariance the RG. of the variables in § must remain 
i 
0 
non-positive. Noting that d_ for all variables in S_ must be 
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zero the changes in the reduced gradient components of the 


fe) 
variables in S simplifies to 


Gye IG Ee cl Go ee Che 
73 ) ZES Z 7 fA Fh | 7 


Since RG is a non-positive quantity the condition for the 
; 
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Maintenance cf non-positive RG can be expressed as 
J 


Bed 


) 
RG, 2 — a (6 -@e@da)q + ¥ Jes 
5 ZEZ Z ZZ Z,J J 


ama LOr invariance this Condition must be maintained ror ail 


) 
variables in § and throughout the specified restricted 


ranges, that is for 


Ee 
IA 
- 
iA 
o- 


( 
® 
iA 
@® 
lA 
@© 


* 
The condition for the maintenance of non-positive RG. 
J 


) 
for the variables in S can be simplified by examining the 


i 


structure of the constraint matrix W, which has exactly the 


Same structure as the constraint matrix of the linear case. 
Although in- the quadratic case there can be more than one 
variable in the solution that is not at its upper bound the 
structure of W allows for the occurence of only one of then 


in the basis set Z. This arises as follows; 


The occurence of a variable which is not at its eer 
bound in the basis set Z requires that both the varia 

and its slack be in 2Z. This requires that ane 
(n+1)x (n+1) Matrix P, which must be non-singular, 
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contain both the column of the structural variable and 
the column of the slack. Each variable/slack pair after 
the first fills two column dimensions but ony one row 
dimension in P. If an attempt is made to identify 1>1 
variables as not being at_their upper bounds there will 


be (n- itt) filled column dimensions but only (n-1) 
Eilled row dimensions in P. Of the remaining AO ee Ses 
Ww _variables in _the basis, each is identified as being 
at 1 


ts upper bound and fills only one row and only one 
column dimension in P. Thus the net result of trying, to 
oka mere than one variable as not eae at its 
upper ound is an unfilled row dimension in and this 
row of zeros makes P Singular, which 1S ln violation of 
the requirement for P. 
Since only one variable can be identified as being in the 
solution but not at its upper bound the basis in the 
quadratic case is exactly the same as in the linear case and 
the representation of the non-basic columns of W, that is Q, 
at optimality is exactly the same as in the linear case. 


This means that the columns of Q associated with the 


) 
Variables in §S§ have the same structure as tke columns of 


the linear case which are associated with non-basic, and 
therefore zero valued, variables. The columns of Q 


0 
associated with variables in S are eé€ither type A, B, or C 


columns where 


type A = columns associated with structural variables. 
type B = columns associated with slack variables. 
type C = the column associated with the slack of the 


total budget constraint. 
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A. TESTS OF INVARIANCE 


Denote the set of variables which are in the solution 
but not at their upper bounds as the set F. The variable of 
F which is identified as being in the basis but not at its 


upper bound will be denoted as oe With this notation the 
arrangement of the elements in the quadratic type A, 8B, and 


C columns is identical to the arrangement of the elements in 
the linear type A, B, and C columns. For details of these 


arrangements see pages 22, 23, and 25 respectively. 


1. Column Type A (structural variables) 


ED Se oe ee ee a a ee 


0 
POE daa & =85 that are structural variabkles the 
J 


columns of Q will have the structure of the type A column, 


* 
see page 22. Under this condition the summation in the RG. 
J 
Maintenance condition becomes 
(et ees) ol 
a aap a 
oe 


and the condition for the maintenance of non-positive RG. 
r 


is 


jas | > - ( iP - oe + a 
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e 


To obtain a test of invariance the variable identifed as 
being in the solution but not at its upper bound must he the 
Variable in F which has the largest deviation from its 


optimal value marginal return, that is select Sp £0 


6 d : 
ee eae 


The test of invariance for a type A column is 


L L L 
Inc | > max (o¢ +90 4 )+o.. 
2 fe 


Rove 5 


For d €S that are slack variables the columns of 


Q will have the structure of the type B column, see page 23. 


¥e 
Under this condition the summation term in the RG © 
J 


Malntenance condition becomes 


= -~ ed = - © d - 
¥e a8 e Reh q-40 +1) Sesto 


The test of invariance for type B columns is 


L L 
las | > ie ( v. ‘+ ap S3 ) 
pe > es d ) + $ : 
j~ (n+ 1) I= (ieee go (nt 1} j 
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Se cOLummeiype Culbldget Constraint slack Vvarvanple) 


— — == a aa? a =. = SS SS = == =. _— 


The slack variable associated with the total tEudget 
constraint is variable nti. The column of Q associated with 


d : is a type C column, see page 25. Under this condition 
nt 


P 
the summation term in the RG maintenance condition becomes 
3 
= (ior, =O ds} 
iE = £ 
and the test of invariance is e 
L L 
[RG | > aco et Oca 
J Hee t fot 


The solution is Said to be invariant with respect to the 


Specified parameter ranges if the tests of invariance hold 


0) 
BOr all des. 
J 


The tests developed above are sufficient but not 
necessary conditions EOE invariance. Under certain 
conditions violaticn of the sufficiency test for a type B 


column may not result ina violation of invariance. This 


+ 
Will occur when a variable in § Cahn become zero without 


) 
requiring a variable in S$ to become positive. The condition 


for this cccurence is that it must be possible to allocate 
all of the units of resource from the variable dropping to 
zero to the variables in the solution set that are not at 
their upfer bounds. If the sufficiency test for a type B 
column is violated for slack variable ia new condition for 


invariance should be checked. This condition is 
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d- > (ub - ad). 
i- (n+1) feF f ie 
If this condition is satisfied the solution is not invariant 


Since the units of resource not allocated to the variables 


re) 
in F must be allocated to a variable in § to maintain 


optimality. If this condition is violated the solution may 
be invariant and to determine whether or not the solution is 


invariant requires additional algorithm iterations. 


As in the linear case there is a logical statement 
of the tests of invariance. This is derived by recognizing 
that the reduced gradient algorithao pps Se allocate 
incremental units of resource in decreasing order cf the 
mMaXlmum marginal returns. At optimality all variables in the 
solution put not at their upper bounds will have a common 
Marginal rate cf return &, As long aS the parametric 


perturbations allowed by the restricted ranges do not cause 


0 
the marginal return at zero of a variable in § to recone 


+ 
larger than the marginal return of any variable in S the 
solution will be invariant. This test of invariance is 
equivalent te the tests developed above and can be expressed 
as 

6 . Ie ie 
max (a +>, ) < min (a +> ) - (Bb +8 Ja. 
JOSS 7 j jie Sd) j 3 j D 


If within the specified restricted ranges the condition is 


Satisfied the solution 1S Said to be invariant. 


51 





The invariance criterion and the definitional framework 
in which it is applied provide an approach toward the 
optimization of the stochastic program posed by the overhaul 
planning proklem. The complement of tne optimal solution set 
of the deterministic reformulation identifies the stages in 
Which no advance planning and procurement should be 
undertaken and the solution sensitivity analysis under the 
invariance criterion provides some control over the risk 
involved in basing decisions on a deterministic solution to 
a stochastic problem. The key is that the risk is only 
centrolled since even if a solution satisfies the invariance 
criterion there is a positive prebability ia & the 
realizaticns of the stochastic parameters will fall outside 
the restricted ranges used for the invariance criterion. 
Thus even if a solution satisfies the invariance criterion 
it should not be regarded as an exact answer, but as a 
foundation on which objective management decisions can be 
based. Even if a solution fails the tests of invariance 
there is a positive result, the stages which are suscertible 
to stochastic behavior can be identified. For a solution 
which fails to satisfy the invariance criterion there are 


two ways to move toward invariance. 


1. Reduce the variance of the estimate used in the 
deterministic reformulation. This generally 
requires an enlargement of the data base used in the 


estimation. 


2. Reduce the restricted ranges on which the tests of 


Mmiveartance were based. This will inerease the risk 


3) 





associated with decisions based on the solution as 
there will be a greater probability of realizations 
of the stochastic parameters falling outside the 


restricted range. 


A significant improvement in the invariance criterion 
could be achieved if the level of risk associated with an 
invariant sclution could be specified. This would require 
the development of a probability statement addressing the 
forme probability of violating the specified restricted 
ranges of the stochastic parameters. Unfortunately a 
realistic development of this probability statement would 
require dropfing the assumption of independence for the 
parametric perturbations and would necessitate the 
developmert cf joint restricted ranges for the dependent 
parameters. This will greately complicate the mathematics of 


the invariance analysis. 
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